Infringement detection method, device and system

ABSTRACT

A method for detecting an infringement by vehicle operator is described. The method comprises detecting a vehicle; receiving one or more image of at least a part of the vehicle operator; automatically analysing with a neural network the one or more captured received image to detect an infringing act; and providing the one or more captured received images comprising the detected infringing act to thereby detect the infringement. Also described are a system, a device, a computer system and a computer program product all for detecting an infringement by a vehicle operator. The device may comprise one or more flash for illuminating the vehicle or a part thereof with light at a narrow band and one or more camera comprising a narrow band filter that lets through only the wavelengths of light produced by the one or more flash.

FIELD OF THE INVENTION

The present invention relates to an infringement detection method,device and system. In one embodiment this invention relates to aninfringement detection method device and system for detecting distractedoperation of a vehicle.

BACKGROUND TO THE INVENTION

Traffic infringements such as, distracted driving and speeding, are amajor source of death, injury and financial cost. While autonomous carshave the potential to solve or at least lessen this problem, these carsare not immediately available. Also, while device-based lockouts andin-vehicle technology may reduce instances of distracted driving andspeeding, these are not across the board viable solutions becausevehicle operators must opt-in. US Patent Publication Nos. 20110009107and 20130271605 describe examples of in-vehicle lock-out devices.Accordingly, enforcement is currently the only credible short termsolution.

Video cameras and other cameras are known to be used to detect vehiclesand record evidence. This approach is deficient in the areas of 24/7operation and generation of high quality prosecutable evidence.

Australian Patent No. 20020141618 discloses a system for monitoring andreporting incidences of traffic violations at a traffic location. Thesystem comprises a digital camera system deployed at a traffic location.The camera system is remotely coupled to a data processing system. Thedata processing system comprises an image processor for compilingvehicle and scene images produced by the digital camera system, averification process for verifying the validity of the vehicle images,an image processing system for identifying driver information from thevehicle images, and a notification process for transmitting potentialviolation information to one or more law enforcement agencies.

Australian Patent No. 20120162432 describes a point to point speedsystem, the implementation of which uses an anonymised method of storingthe images.

Australian Patent No. 20120007983 describes a two-image process, wherebya first image is used to obtain a license plate and a second image isused to gather evidence of the offence.

Australian Patent No. 20090046897 describes secondary image speedverification, using two photos to confirm speed via image means.

Australian Patent No. 20090207046 discloses a method for detectingvehicles by first detecting the license plate.

Australian Patent No. 20060047371 describes coupling an automated numberplate recognition (ANPR) camera to a loop detector.

Australian Patent No. 20050073436 teaches alerting an officer on alicense plate hit.

U.S. Pat. No. 6,266,627 describes detecting a vehicle's speed usingradar, and capturing photos if vehicle is over a threshold.

Various technologies have been described which provide rudimentarymechanisms for detecting distracted driving.

US Patent Publication No. 2008/0036623, the publication of U.S. patentapplication Ser. No. 11/678,489, describes a method and apparatus forautomated detection of mobile telephone usage by drivers of vehicles.The apparatus includes a detection system comprising at least one mobilephone signal receiving device, at least one image capturing device, andat least one computer. The mobile phone signal receiving device isoperative to detect a mobile phone signal transmitted from a vehicle.The at least one image capturing device is operative to capture at leastone image of the vehicle. The at least one computer is operative tostore in a storage device, information associated with at least one ofthe mobile phone signal transmitted from the vehicle; and the at leastone image of the vehicle. The information stored in the storage devicemay be used to determine if a person associated with the vehicle shouldbe prosecuted for illegal use of a mobile phone while driving thevehicle. This document also teaches using vantage points offset to theleft or right of the driver to capture a respective hand gripping amobile telephone, or a vantage point sufficiently close to straight infront. The use of an Artificial Intelligence system to detect use of aphone by an occupant, or other infringements, is also described.

US Patent Publication No. 2010/00271497, the publication of U.S. patentapplication Ser. No. 12/769,41, describes a traffic monitoring systemand methods of use. This traffic monitoring system may be suitable forautomatic monitoring of vehicle traffic at desired locations such as,for example, traffic lights, school zones, construction zones, remotelocations, locations having high traffic accidents and/or locations withfrequent traffic violations. The traffic monitoring system may beemployed for detecting traffic violations involving a vehicle (e.g.,running a red light, speeding and/or driving while using a mobile orcellular phone) and collecting information associated with the vehicleand/or the operator of the vehicle. The traffic monitoring system mayinclude one or more portability features that may make this systemwell-suited for deployment and redeployment at any number of desiredlocations, for example where traffic monitoring is desirable butsuitable permanent infrastructure is not in place or is costprohibitive.

International Patent Publication No. WO2015/017883, the publication ofInternational Patent Application No. PCT/AU2014/00783 describes apotential driving infringement flagging system comprising an imagesource that captures or receives an image of a driver of a vehicle oranother person within the vehicle; a processor configured to analyse theimage to determine whether the driver is using a mobile telephone whiledriving or whether the driver or the person is wearing a seatbelt; andan output that indicates the result of the analysis. The localisation ofthe driver is performed by setting a region in relation to the rest ofthe vehicle in which the driver is generally positioned. Thislocalisation is varied with different types of vehicles. The mobilephone may be detected by searching for a visual footprint and/or imagefeatures associated with face. A sub-test may analyse the image todetermine whether a hand is visible in the image within a distance fromthe perimeter of the face or if the driver is looking down.

The reference to any prior art in this specification is not, and shouldnot be taken as, an acknowledgement or any form of suggestion that theprior art forms part of the common general knowledge.

SUMMARY OF THE INVENTION

Generally, embodiments of the present invention relate to aninfringement detection method, device and system. In one embodiment thisinvention relates to an infringement detection method device and systemfor detecting distracted operation of a vehicle.

In a first form, although it need not be the only or indeed the broadestform, the invention resides in a method for detecting an infringement byvehicle operator, the method comprising: receiving one or more image ofat least a part of the vehicle operator; automatically analysing the oneor more received image to detect an infringing act; and providing theone or more received image comprising the detected infringing act tothereby detect the infringement.

The method of the first form may further comprise detecting a vehicle.

The method of the first form may further comprise capturing one or moreimage of at least part of the vehicle operator. The vehicle beingoperated may be that vehicle detected.

According to one embodiment of the first form, the method is a computerimplemented method. According to this computer implemented embodiment,the automatic analysing may be with a processor.

In a second form, the invention resides in a system for detecting aninfringement by vehicle operator comprising: a computer for receivingone or more image of at least a part of a vehicle operator; a computerprocessor for automatically analysing the one or more received image todetect an infringing act; and the computer or another computer providingthe one or more received image comprising the detected infringing act tothereby detect the infringement.

According to one embodiment of the second form, the one or more imagemay be received through a computer network.

The system of the second form may further comprise detecting a vehicle.

The system of the second form may further comprise capturing one or moreimage of at least part of the vehicle operator. The vehicle beingoperated may be that vehicle detected.

The another computer of the second form may be operatively connected tothe computer. The operative connection may be through a computernetwork.

In a third form, the invention resides in a computer program productcomprising: a computer usable medium and computer readable program codeembodied on said computer usable medium for detecting an infringement bya vehicle operator, the computer readable code comprising: computerreadable program code devices (i) configured to cause the computer toreceive one or more image of at least a part of the vehicle operator;computer readable program code devices (ii) configured to cause thecomputer to automatically analyse the one or more received image todetect an infringing act; and computer readable program code devices(iii) configured to cause the computer to provide the one or morereceived image comprising the detected infringing act to thereby detectthe infringement.

The computer program product of the third form may further comprisecomputer readable program code devices (iv) configured to cause thecomputer to detect said vehicle.

The computer program product of the third form may further comprisecomputer readable program code devices (v) configured to cause thecomputer to capture one or more image of at least part of the vehicleoperator. The vehicle being operated may be that vehicle detected.

In a fourth form, the invention resides in a device for detecting aninfringement by a vehicle operator, the device comprising: one or moresensor for detecting a vehicle; one or more camera for capturing one ormore image of at least a part of the vehicle operator; one or morecomputer processor for automatically analysing the one or more capturedimage to detect an infringing act; and one or more output for providingthe one or more captured image comprising the detected infringing act tothereby detect the infringement.

The device of the fourth form may further comprise one or more flash toilluminate the detected vehicle or part thereof with light at a narrowband.

The one or more camera according to the fifth embodiment may comprise anarrow band filter that lets through only the wavelengths of lightproduced by the one or more flash.

In a fifth form, the invention resides in a method for detecting aninfringement by a vehicle operator, the method comprising: detecting avehicle with one or more sensor; capturing one or more image of at leasta part of said vehicle operator with one or more camera; automaticallyanalysing the one or more captured image to detect an infringing act;and providing the one or more captured image comprising the detectedinfringing act to thereby detect the infringement.

The method of the fifth form may further comprise illuminating thedetected vehicle or part thereof with one or more flash with light at anarrow band.

The capture according to fifth form may be capture wherein at least oneof the one or more camera comprises a narrow band filter that letsthrough only the wavelengths of light produced by the one or more flash.

In a sixth form, the invention resides in a computer system fordetecting an infringement by a vehicle operator, the computer systemcomprising: one or more sensor for detecting a vehicle; one or morecamera for capturing one or more image of at least a part of the vehicleoperator; a computer processor for automatically analysing the one ormore captured image to detect an infringing act; and an output forproviding the one or more captured image comprising the detectedinfringing act to thereby detect the infringement.

According to the sixth form the system may further comprise one or moreflash for illuminating the detected vehicle or part thereof with lightat a narrow band.

The capture according to the sixth form may be capture wherein at leastone of the one or more camera comprises a narrow band filter that letsthrough only the wavelengths of light produced by the one or more flash

In a seventh form, the invention resides in a computer program productcomprising: a computer usable medium and computer readable program codeembodied on said computer usable medium for detecting an infringement bya vehicle operator, the computer readable code comprising: computerreadable program code devices (a) configured to cause the computer todetect a vehicle based on input from one or more sensor; computerreadable program code devices (b) configured to cause the computer tocapture with one or more camera one or more image of at least a part ofthe vehicle operator of the detected vehicle; computer readable programcode devices (c) configured to cause the computer to automaticallyanalyse the one or more captured image to detect an infringing act; andcomputer readable program code devices (d) configured to cause thecomputer to provide the one or more captured image comprising thedetected infringing act to thereby detect the infringement.

The computer program product of the seventh form may further comprisecomputer readable program code devices (e) configured to cause thecomputer to illuminate the detected vehicle or part thereof with one ormore flash with light at a narrow band.

The capture according to the seventh form may be capture wherein atleast one of the one or more camera comprises a narrow band filter thatlets through only the wavelengths of light produced by the one or moreflash.

The one or more camera of any one of the above forms may comprise a 5 to50 MP; 10 to 45 MP; or 20 to 35 MP camera. The one or more camera maycomprise a sensor selected to maximise light sensitivity and/or minimisenoise. The camera sensor may enable high quality low-light images to beobtained. The sensor may comprise excellent dynamic range. The dynamicrange may comprise at least 66 dB or greater than 70 dB. The one or morecamera may comprise a rolling-shutter or a global shutter. In oneembodiment the one or more camera comprises a global shutter. The one ormore camera may comprise a monochrome camera. The one or more camera maycomprise a minimum exposure time of at the slowest 0.5 ms ( 1/2000th);0.1 ms ( 1/10000th); or 0.2 ms ( 1/5000th). The exposure time maycomprise a range of 0.05 ms to 0.5 ms; or 0.1 to 0.3 ms.

The one or more camera of any one of the above forms may comprise one ormore filter. The one or more camera may or may not comprise an infra-red(IR)-blocking filter. The one or more camera may comprise a narrow bandfilter applied to a front or rear of the one or more lens. The narrowband filter may let through only the wavelengths of light produced bythe respective flash of the one or more flash. This narrow band filtermay eliminate the majority of ambient light and/or light produced by thesun. When the one or more flash comprises an 850 nm flash, the one ormore filter may let through light only between 700 and 1000 nm; 750 and950 nm; 800 and 900 nm; 820 and 890 nm; 830 and 880 nm; 850 and 870 nm;or 840 and 860 nm. The one or more filter may eliminate about 90%; about95% or about 97.5% of the light normally visible by the camera, lettingthrough only the light at the same wavelength as the respective one ormore flash.

The narrow band filter may block all light or substantially all lightexcept that light at or around a particular wavelength.

The narrow band filter may comprise a wavelength band of less than 5 nm;5; 10; 15; 20; 25; 30; 35; 40; 45; 50; 55; 60; 65; 70; 75; 80 85; 90;95; 100; 110; 120; 130; 140; 150; 200; 250; 300; 350; 400; 450; or 500nm. The narrow band filter may comprise a wavelength band of 5 nm orless; 10 nm or less; 15 nm or less; 20 nm or less; 25 nm or less; 30 nmor less; 35 nm or less; 40 nm or less; 45 nm or less; 50 or less; 55 nmor less; 60 nm or less; 65 nm or less; 70 nm or less; 75 nm or less; 80nm or less; 85 nm or less; 90 nm or less; 95 nm or less; or 100 nm orless.

In one particular embodiment, the narrow band filter may comprise aBi850 Near-IR Interference Bandpass Filter.

In another particular embodiment, narrow band filter may comprise auseful range of 845 to 860 nm, that is a range of 15 nm.

The one or more camera of any one of the above forms may comprise one ormore lens such as, a varifocal lens. The one or more camera may comprisea C mount lens or a larger format camera. The one or more camera maycomprise a fixed lens such as, an industrial fixed focal length lens.The industrial fixed focal length lens may comprise a rating of 12 MP.In one embodiment the one or more camera lens rating matches or exceedsthe sensor to avoid image blur.

The one or more lens according to any one of the above forms maycomprise a focal length of 10 to 100 mm; 20 to 80 mm or 30 to 60 mm. Formobile installation the focal length may comprise 20 to 50 mm; 25 to 45mm; or 30 to 40 mm. For mobile installation the focal length maycomprise 35 mm. For fixed installation the focal length may comprise 35to 65 mm; 30 to 60 mm or 45 to 55 mm. For fixed installation the focallength may comprise 50 mm. The focal length may be selected to providetight zoom onto the vehicle for higher resolution and enough width andcontext to show one or more of: an entire width of the vehicle; most ofa lane; and vehicle number plate.

According to any one of the above forms, the one or more camera may ormay not comprise a polarizer.

In one embodiment of any one of the above forms, the one or more cameramay comprise one or more flash for illuminating the detected vehicle ora part thereof. The one or more flash may comprise one or more of a 760nm and an 850 nm flash. The one or more flash may be capable of firing10,000 to 100,000; 20,000 to 80,000 or 30,000 to 50,000 times per day athigh intensity and short duration. In one embodiment, the one or moreflash is capable of firing 40,000 times per day at high intensity andshort duration. The one or more flash may comprise one or more lightsource, the one or more light source may comprise one or more LED lightsource and/or one or more laser light source. The one or more lightsource may comprise a narrow-spectrum. The one or more light source maycomprise 10 to 1,000; 40 to 500; 300 to 400 light sources. Each of theone or more light sources may comprise an IR LED light source. The oneor more light source may be tightly aimed using individual lenses. Theindividual lenses may be at 1 to 35; 15 to 30; or 20 to 25 degrees. Inone embodiment the individual lenses are at 22 degrees. The one or moreflash may comprise one or more capacitor bank to store charge betweenflashes. The one or more light source when triggered may generate a highintensity of light for a very short duration.

In one particular embodiment of any one of the above forms, the one ormore camera comprises a 12 MP C Mount camera with a Sony Pregius globalshutter sensor.

According to any one of the above forms, the light source may comprise atightly controlled wavelength. The tight control may comprise a narrowspectral band. The one or more camera filter may exclude all light notwithin the controlled spectral band. In one embodiment the tightlycontrolled wavelength comprises a narrow spectrum light source. Thenarrow spectrum light source may transmit with a full width at halfmaximum (FWHM) spectral bandwidth of 5; 10; 20; 25; 30; 35; 40; 45; or50 nm.

In a particular embodiment of any one of the above forms, the one ormore light source may comprise an Oslon Black, Oslon Black Series 850 nm−80°, SFH 4715AS available from Osram Opto Semiconductors.

According to any one of the above forms, the spectral bandwidth may bedetermined at 50% Irel,max full width at half maximum (FWHM).

The one or more flash may comprise a main flash and a separate offsetflash for license plates.

One or more camera setting may be changed between capture of respectiveimages comprised in the one or more image. The setting may be changedrapidly and/or automatically. The one or more camera setting maycomprise exposure time and/or flash intensity.

According to any one of the above forms, an auxiliary camera may becomprised. The auxiliary camera may capture one or more image of avehicle license plate.

In one embodiment of any of the above forms, a high angle into thevehicle for the camera may be used in order to see the infringement. Theangle may comprise 30 to 90; 35 to 90; or 40 to 90 degrees vertical froma ground plane to camera. In one embodiment the angle may comprise 65degrees. The angle may comprise 30; 31; 32; 33; 34; 35; 36; 37; 38; 39;40; 41; 42; 43; 44; 45; 46; 47; 48; 49; 50; 51; 52; 53; 54; 55; 56; 57;58; 59; 60; 61; 62; 63; 64; 65; 66; 67; 68; 69; 70; 71; 72; 73; 74; 75;76; 77; 78; 79; 80; 81; 82; 83; 84; 85; 86; 87; 88; 89 or 90 degrees. Inanother embodiment, a minimum 40 degrees vertical from a ground plane tocamera is used. When the vehicle is a truck lower angles may be requiredthan for a passenger car.

According to any one of the above forms, a camera mount position ofbetween 2 and 15; 3 and 12; or 4 and 10 m above the road surface iscomprised. In one embodiment the mount position is a minimum of 4 mand/or 7 to 10 m above the road surface.

In another embodiment of any one of the above forms, a camera mountposition comprising a horizontal angle of between −70 and 70; −45 and 45and −30 to 30 degrees may be comprised. In one embodiment of a roadsideuse, the horizontal angle may comprise up to 45 degrees. In oneembodiment of an over-the-lane use, the horizontal angle may comprise 0degrees. The over-the-lane use case may comprise a fixed installation ofa high camera.

In yet another embodiment of any one of the above forms, the one or morecamera may be positioned to a passenger side of the vehicle.

The one or more camera may comprise two or more cameras to provideadditional angles into the vehicle. The two or more cameras may providedepth information via stereoscopic means to enhance detection accuracy.

In still another embodiment of any one of the above forms, a videocamera is further comprised. The video camera may provide one or more ofadditional context; wider field of view; sustained evidence ofdistraction over several seconds; and license plate information.

According to any one of the above forms a processor may be comprisedwithin a computer. The computer may be connected to the device at theinstallation site or via a network connection. The network connectionmay comprise an Ethernet connection. The computer may be up to 100 maway. The computer may be mounted within 5 m. The computer may compriseone or more graphics card to improve processing speed. The computer maycomprise a Linux operating system.

The automatic image analysis may comprise classification of an image asshowing a driver using a phone or mobile device and/or detect a phone ormobile device in an image and reports the phone or mobile devicelocation.

The one or more image may comprise one or more standardised image. Theone or more standardised image may comprise one or more cropped imagecomprising standard width and height centred or substantially centred ona driver coordinate. The width and height may be chosen to capturecomplete detail of the driver and exclude any passengers. The one ormore cropped image may be padded with grey so that the driver coordinateremains in the centre and the one or more cropped image is standardsize. The one or more cropped image may be analysed to determine thebrightest and darkest pixels. An offset may be applied to all pixels inthe one or more cropped image so that the darkest pixels becomes set toa value of zero (0). A scale may be applied to all pixels in the one ormore cropped image so that the brightest pixels become set to a value or255. All other pixels may be linearly scaled between 0 and 255 in ahistogram equalisation operation. The analysis of the one or morecropped image may maximise contrast in the region of interest. The oneor more cropped image may be resized so that the resulting filecomprises a standard filesize.

The one or more cropped image may be adjusted to comprise a standardisedbrightness and/or standardised contrast. The image adjustment may beautomatic such as by computer processing.

The automatic analysis may comprise a detection. The detection of aphone or mobile device may comprise searching the one or more image fora phone or mobile device. The search may comprise a neural network orartificial neural network such as a deep neutral network or a deepconvolutional neural network. The search may be of an entire image. If aphone or mobile device is detected, based on its confidence score theone or more image may be sent for further review. The further review maybe by a person. One or more image may be excluded if a detected phone ormobile device is associated with a passenger and not a vehicle operatoror driver. One or more image may be automatically excluded if the phoneor mobile device is detected in a holder and not grasped by hand.

The captured and/or received image may comprise a view of the completefront of the vehicle and the lane the vehicle is in.

The neural network may comprise an object detection system. The objectdetection system may use a neural network based YOLO (you only lookonce) real time object detection architecture.

The neural network may comprise an image classifier. The imageclassifier may comprise a neural network based VGG (Visual GeometryGroup) classifier. The classifier may receive the one or more croppedimage. The classifier may be pre-trained. The pre-training may comprisetraining on a data set such as, the 1,000 class ImageNet set. The outputmodel of the network may be modified to identify only two classes:received cropped images containing illegal phone or mobile device use,i.e. positive, and received cropped images not containing illegal phoneor mobile device use, i.e. negative. The classifier may have beentrained by fine tuning on a training set of example images. The exampleimages may comprise, more than one hundred, more than one thousand, morethan a hundred thousand, or more than one million example images suchas, cropped images. The training set may comprise positive and negativelabelled images. When the received cropped image of the driver is fedinto the classifier network, the analysis may determine as output aconfidence that the image is positive for phone or mobile device use.The determined confidence may comprise for example a confidence outputof 0% is very unlikely to show phone or mobile device use and aconfidence output of 100% is very likely to show phone or mobile deviceuse. A threshold may be used to limit which images are deemed positiveand which are deemed negative. The threshold may comprise a thresholdvalue which may be dynamically adjusted so that a top margin of imagesare deemed positive and sent on for manual review. The top margin maycomprise a top 5; 10; 15; 20; or 25% of received cropped images withrespected to determined confidence.

According to any one of the above forms, the analysis may comprise areal time object detector. The real time object detector may identifythe driver by the presence of a steering wheel and the human behind thatwheel. The training set may comprise images from various anglesoptionally, both vertical and horizontal angle variations. The trainingset may comprise images of many different vehicle types, and optionallyimages of both left hand drive vehicles and right hand drive vehicles.The analysis may comprise a positive identification of the driver andignore passengers. The real time object detector may output a locationof the driver in the image and optionally a confidence score that thedriver has been found.

According to any one of the above forms, when the driver has beenlocated in the received image, the received image may be cropped.

The standardised one or more cropped image may be supplied to the imageclassifier. The image classifier may receive the standardised one ormore cropped image. The image classifier may have been trained on atraining set comprising a plurality of driver cropped image examples.The training set contains labelled images of drivers illegally touchingphones or mobile device, non-illegally touching phones or mobile device,and not touching phones or mobile devices at all. When the image of thedriver is received by the image classifier, an output comprising a mostlikely category and a confidence score of making that determination maybe provided.

The classification may comprise determining the location of a driver inthe one or more image. The determination of the location may comprisesteering wheel detection and/or person detection. After determinationthe one or more image may be cropped to generate an image showing onlythe driver and the driver's immediate surrounds. The immediate surroundmay comprise a driver's wingspan. The cropped image may then be providedfor further review. The further review may be by a person.

According to any one of the above forms, the detection may comprise aconfidence factor or threshold. In one embodiment, only the one or morecaptured images above a threshold are provided. The confidence thresholdmay be adjusted. The threshold may comprise a setting of 0% of offencesmissed, 100% of images processed manually to 100% of offences missed, 0%of images processed manually. In one embodiment, the threshold comprises5% missed for 10% manual processing.

The further review may be conducted by a person and may comprise amulti-stage process. The further review may be conducted when a highconfidence level is determined. The multi-stage process may comprise oneor more of: generation of a cropped image of a driver from the one ormore image; uploading the cropped image to a server; a log in to an“image review” website; presentation of the cropped image; selection ofone of four options: 1) On phone or mobile device; 2) Not on phone ormobile device; 3) Uncertain; and 4) Other; if 1); 3) or 4) are selected,a message may be sent to the camera system; and the next cropped imagemay then be presented for review or further review.

The server may comprise a cloud server. The server may comprise an AWSSQS (Amazon Web Services Simple Queue Service). The log in may compriseentering login credentials. The message may be sent by the server.

According to any one of the above forms, the providing may be forfurther review or confirmation. The further review may be by a human.The providing may be through a computer or telecommunications network.The further review or confirmation may comprise evaluating whether theimage shows a driver clearly using a phone or mobile device; a driverclearly not using a phone or mobile device; or an uncertainclassification. The classification may provide a confidence score ofeach categorization. When on-phone or on-mobile device use confidenceexceeds a threshold and/or non-on-phone or mobile device use is lowerthan a threshold, the image may be sent for further review.

In one embodiment of any one of the above forms, the providing may be toa nearby intercept vehicle. The intercept vehicle may comprise a policevehicle. The intercept vehicle may receive the provided one or morecaptured imaged after further review. The one or more image may beprovided to the nearby intercept vehicle when a high likelihood of phoneor mobile device use or infringement is determined. The further reviewmay be remote or by dedicated person deployed on site. The interceptvehicle may be provided with the one or more image on a personalcomputing device such as, a mobile phone or a mobile device.

The providing may comprise a transfer of the incident file or one ormore image to a server. The incident file or one or more image may betransferred to a designated folder within the server.

The incident file or one or more image may be downloaded from the serverfor the further review. The further review may comprise un-encryptionand/or extraction of the incident file. The incident file may beprocessed as would a red light; speed or other traffic infringement.

According to any one of the above forms, a registration lookup andinfringement notice may be sent to a registered owner of the vehicle.

In another embodiment of any one of the above forms, one or more of thesensor, camera and/or processor are mounted to a fixed installation;mounted to a tripod; mounted to a vehicle; or mounted to a trailer. Thefixed installation may comprise a gantry; a bridge; or other structure.The tripod may be temporarily deployed at a desired location. Thetrailer may comprise a work-light trailer. The fixed installation andtrailer mount may comprise a high up mounting. In another embodiment,the processor is in a remote location.

In yet another embodiment of any one of the above forms, with the methodcomprises providing a power supply and/or the device comprises a powersupply. The power supply may comprise one or more battery.

According to any one of the above forms, the one or more infringementcomprises distracted driving or distracted operation of the vehicleand/or mobile phone or mobile device use. The infringement may compriseuse of a mobile devices such as a tablet computer; a laptop computer; asmart watch; a gaming device; or any device with a display screen. Theinfringement may also comprise failure to wear a seatbelt and/orincorrect seating or restraint of the driver or one or more passenger.

According to any one of the above forms, the detection and/or sensor maycomprise a radar. The radar may comprise a speed enforcement grade 3D or4D tracking radar. The radar may be used to trigger the camera tocapture the one or more image.

According to any one of the above forms, the vehicle may be a motorvehicle such as, an automobile, a car, a van, a truck, a moped, amotorbike or a bus.

According to any one of the above forms, the one or more captured imagemay be provided to a Road Authority or to Police.

In one embodiment of any one of the above forms, the capture of the oneor more image is triggered by the detection and/or the one or moresensor. The triggered capture allows one or both of: capture at aprecise position; and sufficient illumination. The capture may be whenthe vehicle reaches an image capture point.

The one or more image may be provided with additional data. Theadditional data may comprise one or more of vehicle speed; averagespeed; site location; and timestamps. The one or more image and/or theadditional data may be comprised in an incident file. The incident filemay be encrypted using one or more encryption method. The incident filemay comprise a SQLite database file. The encryption may comprise arandomly generated AES symmetric key. The AES key may then be encryptedusing an RSA public key and be packaged with the infringement file. Thefile may only be un-encrypted with the RSA private key in order toaccess the AES key. The one or more image and additional data may behashed and encrypted using a private key. The hash may be checked usingthe public key.

The one or more image may comprise at least one image comprising alicense plate; and at least one image comprising the infringing act. Theone or more image may comprise images at more than one view angle.

The one or more image comprising the license plate may be captured at areduced exposure setting. The reduced exposure setting may comprise alower gain and/or exposure time. The at least one image comprising theinfringing act may be captured at an increased exposure setting. Theincreased exposure setting may comprise a higher gain and/or exposuretime. The plate image may be exposed at a level of 1% to 50% relativemagnitude of the infringing act setting. In one embodiment the plateimage is exposed at a level of 5%.

In another embodiment of any one of the above forms, a real-time displayof offences on a variable message sign may show images of theinfringements.

In still another embodiment, a survey service may be provided showingprevalence of infringement by time of day, vehicle type, location oranother parameter or variable.

Further aspects and/or features of the present invention will becomeapparent from the following detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

In order that the invention may be readily understood and put intopractical effect, reference will now be made to embodiments of thepresent invention with reference to the accompanying drawings, whereinlike reference numbers refer to identical elements. The drawings areprovided by way of example only, wherein:

FIG. 1 is a flowchart showing a method according to one embodiment ofthe invention.

FIGS. 2A and 2B are schematic diagrams showing one embodiment of acomputing device and computer system according to the invention.

FIGS. 3A to 3H show example images captured with a tripod deploymentduring the day with no flash according to one embodiment of theinvention.

FIGS. 4A to 4F show example images captured with a vehicle deploymentduring the day with a flash according to another embodiment of theinvention.

FIGS. 5A to 5D show example images captured with a vehicle deploymentduring the night with a flash according to another embodiment of theinvention.

FIG. 6A shows a suitable flash according to one embodiment of theinvention.

FIG. 6B shows a vehicle mounted device according to one embodiment ofthe invention and incorporating the flash of FIG. 6A.

FIG. 6C shows a gantry mounted device according to one embodiment of theinvention and incorporating the flash of FIG. 6A.

FIG. 7A shows a trailer or mobile based device according to oneembodiment of the invention.

FIG. 7B shows a fixed device according to another embodiment of theinvention deployed in this example on an overpass.

FIG. 7C shows another fixed device according to another embodiment ofthe invention deployed in this example on a gantry for a variablemessage sign (VMS).

FIG. 8A shows an example captured image in one successful deployment ofthe device and method according to one embodiment of the invention.

Skilled addressees will appreciate that elements in the drawings areillustrated for simplicity and clarity and have not necessarily beendrawn to scale. For example, the relative dimensions of some elements inthe drawings may be distorted to help improve understanding ofembodiments of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

Embodiments of the present invention relate to an infringement detectionmethod, device and system.

The invention is at least partly predicated on the inventor's unexpecteddiscovery that, in one embodiment, by avoiding glare and having enoughlight and resolution to penetrate through the windshield to see theoffending behaviour an infringement could be detected. Furtherregarding, in image recognition the inventor has discovered thatefficiency can be obtained by reducing the search space and by havinghumans review the least number of images.

Surprisingly, the inventor has found that, in one embodiment of theinvention, removing glare from windshields by using a tight spectrumflash and tight spectrum filtering on the camera, may advantageouslyremove light from other sources such as the sun, and may only providethe artificial illumination for image capture.

Although it will be described with reference to mobile phone use as aninfringement, the invention is not so limited. For example, use of othermobile devices such as, tablet and laptop computers; smart watches; andgaming devices may be a detected infringement.

In one embodiment, the present invention captures prosecutable evidenceof people using their phone or mobile device while operating a motorvehicle. The system may operate semi-autonomously to capturephotographic evidence and may automatically detect the use of the phoneor mobile device.

As show in FIG. 1, in one embodiment, the method 100 of the inventioncomprises four major steps: detect 110 a vehicle; capture 120 one ormore image; analyse 130 for computing device use; and provide 140 theone or more image to detect the infringement.

The invention may be used with four different installation platforms.The first is with equipment mounted to a fixed installation such as agantry, bridge or other structure. This is similar to how apoint-to-point (average) speed system is installed. The second is withequipment tripod mounted and deployed temporarily with battery powersupply. The third is with equipment mounted to a vehicle for mobileoperations. This is very similar to a mobile speed camera. The fourth iswith equipment mounted to a trailer, similar to a work-light trailer,with cameras mounted very high up so as to replicate a fixedinstallation height.

The one or more captured image may be dealt with using one or two datause cases. In a first, evidence is captured and then transmitted to aback office system. This is the same way that speed and red-lightcameras operate. The second is for the one or more image to betransmitted to a nearby police intercept vehicle. The evidence may ormay not have been reviewed by a human operator first.

In order to capture vehicles travelling at any speed, and to capture thevehicles at very precise positions along the road, and to illuminateeach image sufficiently, a triggered image capture system may be usedrather than a video system. A radar may be used to detect a vehicle, andthen when the vehicle reaches the appropriate image capture point, oneor more camera captures one or more image. The one or more image may bepackaged together along with other data such as vehicle speed, sitelocation and accurate timestamps into an incident file. The incidentfile may then be encrypted using a combination of encryption methods.

An incident file is a package of images and metadata such as, one ormore of detection data; location; vehicle details; phone use detectionscores; etc., which is digitally signed. Typically, the incident filewill be encrypted.

In one embodiment the radar comprises a speed enforcement grade 3D or 4Dtracking radar. The radar accurately tracks the position and speed ofall vehicles, informing the one or more camera when to capture images.

FIG. 6A shows one embodiment of a flash 400 suitable for use within avehicle mounted device 300 according to one embodiment of the invention.

FIG. 6B shows one embodiment of a camera 600 comprised in device 300according to one embodiment of the invention. Camera 600 comprises a 12MP C Mount camera with a Sony Pregius global shutter sensor used.

FIG. 6C shows one embodiment of a gantry mounted device 300 in which theflash 400, radar 500 and camera 600 can be readily seen.

Advantageously, the sensor type selected maximises light sensitivity andminimises noise, permitting high quality low-light images. The sensormay have excellent dynamic range, which advantageously, overcomesproblems associated with ‘plate burn’, whereby the backing of thelicense plate is overexposed due to flash energy, which then alsooverexposes the lettering too making the plate illegible. The sensorused may be fairly unique in its ability to overcome this. By excellentdynamic range is meant a range comprising at least 66 dB; or greaterthan 70 dB.

Most sensors are rolling-shutter, which presents image distortion forfast moving objects. When a global shutter camera is utilised, allpixels may be exposed simultaneously and therefore have no motion-baseddistortion.

In one embodiment, the one or more camera's IR-blocking filter isremoved, so that it is sensitive to infrared light.

In the embodiment used to capture the images shown in the Figures, theone or more camera was monochrome to improve light sensitivity and imagesharpness. In other embodiments, a colour camera is used with reducedimage quality as a result.

To avoid motion-blur, the exposure time of the one or more cameracomprises at the slowest 0.5 ms ( 1/2000th), and should ideally be setto 0.1 ms ( 1/10000th). The exposure time may comprise 0.05 ms to 0.5 msor more typically may comprise 0.1 to 0.3 ms. In practice 0.2 ms (1/5000th) is typically used. These settings ensure crisp images forvehicles travelling at 100 km/h and will still provide acceptable imagesfor vehicles travelling as fast as 300 km/h.

The resolution of the one or more camera may be high enough to providesufficiently accurate evidence that one can identify that the object inthe person's hand is clearly a phone or mobile device and not anotherobject.

The inventor found that video camera resolution (2 MP) is insufficient.Testing with both 9 MP and 12 MP, showed that at minimum 5 MP isrequired. Higher resolutions, e.g. 20 MP+, have other problems such ashigher sensor noise, lower sensitivity or high cost.

By taking multiple images, the license plate may be captured in anearlier photo and the distracted driving evidence in a later photo. Tocapture the license plate, the exposure settings of the camera may bereduced (e.g. lower gain and exposure time), while to capture thedistracted driving behaviour, the exposure settings of the camera shouldbe increased, with a higher gain and exposure time. For example, a plateimage may be exposed at a level of 1% to 50% relative magnitude of theinfringing act setting. In one particular embodiment, the plate image isexposed at 5%.

The camera settings can be changed rapidly and automatically between thecapture of each image to facilitate this. If this is not done, theimages of phone or mobile device use will be too dark and lack detail,and the license plates will be too bright, overexposed by flash, andrisk illegibility. Other options to solve this can be utilized, forexample by changing flash intensity between images or by using aseparate offset flash for illumination and thereby detection of licenseplates, or by using another camera for license plates.

In one embodiment, a C mount lens is used which allows for a good depthof field, all things in focus, even at the very wide apertures neededfor the application. In other embodiments a larger format camera may beutilised. This is because it is a narrower lens than larger formatlenses. The lens selected may comprise a fixed focus lens such as, anindustrial fixed focal length lens, with a rating of 12 MP. The ratingmay match or exceed the sensor to avoid image blur. In otherembodiments, a varifocal lens may be utilized.

In the embodiment shown in FIG. 6B, the narrow band filter is applied tothe front of the lens, which lets through only the wavelengths producedby the comprised one or more flash. In other embodiments, the narrowband filter is applied behind the lens. This filter eliminates themajority of the light produced by the sun and/or ambient light, therebyeliminating most glare.

The narrow band filter may block all light or substantially all lightexcept that light at or around a particular wavelength. One examplenarrow band filter that has been implemented is the Bi850 Near-IRInterference Bandpass Filter, which is described as having a usefulrange of 845 to 860 nm, that is 15 nm. This narrow band filter isavailable from Midwest Optical Systems, Inc., 322 Woodwork Lane,Palatine, Ill., 60067, USA. From the teaching herein, a skilled personis readily able to select a suitable narrow band filter.

Two flash options may be provided. A first at 760 nm and a second at 850nm. One or both of these flash options may be comprised.

The filter used with the 850 nm flash may let through light only orsubstantially only between 840 and 860 nm, thereby eliminating 98% ofthe available sunlight that would otherwise be seen by the sensor. Inother embodiments, the light let through may be between 700 and 1000 nm;750 and 950 nm; 800 and 900 nm; 820 and 890 nm; 820 and 880 nm; or 850and 870 nm. In the embodiment shown in FIG. 6B, the one or more filtereliminates 97.5% of the light normally visible by the camera and letsthrough only the light at the same wavelength as the one or more flash.In other embodiments, the one or more filter eliminates about 90%; orabout 95% of the light normally visible by the camera, letting throughonly the light at the same wavelength as the one or more flash.

The narrow band filter may comprise a wavelength band of less than 5 nm;5; 10; 15; 20; 25; 30; 35; 40; 45; 50; 55; 60; 65; 70; 75; 80 85; 90;95; 100; 110; 120; 130; 140; 150; 200; 250; 300; 350; 400; 450; or 500nm. The narrow band filter may comprise a wavelength band of 5 nm orless; 10 nm or less; 15 nm or less; 20 nm or less; 25 nm or less; 30 nmor less; 35 nm or less; 40 nm or less; 45 nm or less; 50 or less; 55 nmor less; 60 nm or less; 65 nm or less; 70 nm or less; 75 nm or less; 80nm or less; 85 nm or less; 90 nm or less; 95 nm or less; or 100 nm orless.

The lenses used may have a focal length of 35 mm for mobile installationwhich has a lower mount height and 50 mm for fixed installation whichcomprise a higher mount height. The focal length may be selected toprovide tight zoom onto the vehicle for higher resolution of theevidence. Enough width and context may be provided to show one or moreof the entire width of the vehicle, most of the lane and its numberplate.

A polarizer may or may not be used to additionally reduce glare from thesun.

Advantageously, the one or more flash may be capable of firing 40,000times per day at high intensity but short duration without breaking. Inother embodiments, the one or more flash may be capable of firing 10,000to 100,000; 20,000 to 80,000 or 30,000 to 50,000 times per day at highintensity and short duration. The one or more flash may be required tofire twice or more for each vehicle. Traditional Xenon flashes are notcapable of such high repetition rates, so LED or laser technology may beused. Xenon flashes are also wide-spectrum while LEDs and lasers can benarrow-spectrum.

FIGS. 6A and 6B show one embodiment of a custom design one or more flash400 comprising 384 IR LEDs, tightly aimed using individual lenses at 22degrees comprised within a vehicle mounted device 300 according to oneembodiment of the invention. Large capacitor banks may store chargebetween flashes, and then when triggered the LEDs may generate a highintensity of light for a very short duration.

The one or more flash may comprise one or more light source. The one ormore light source may comprise one or more LED light source and/or oneor more laser light source. The one or more light source may comprise anarrow-spectrum. The one or more flash may comprise one or more lightsource. The one or more flash may comprise 10 to 1,000; 40 to 500; or300 to 400 light sources. Each of the one or more light sources maycomprise an IR LED light source.

In other embodiments, the individual lenses may be at 1 to 35; 15 to 30;or 20 to 25 degrees

The LED wavelength may be tightly controlled to ensure light is providedwithin a determined spectral band, and a camera filter may be used toexclude all light not within that band.

The tightly controlled wavelength may comprise a narrow spectrum lightsource transmitting the majority of its emitted light within 5; 10; 20;25; 30; 35; 40; 45; or 50 nm of its central wavelength.

In one particular embodiment, the one or more light source may comprisean Oslon Black, Oslon Black Series 850 nm −80°, SFH 4715AS availablefrom Osram Opto Semiconductors.

The spectral bandwidth may be determined at 50% Irel,max full width athalf maximum (FWHM).

Both 760 nm and 850 nm flash variants have been used and tested. At 760nm, the camera is more sensitive, however the LEDs available are not asbright as 850 nm ones. Typical vehicle windshields let through morelight at 760 nm than 850 nm. A small red glow can be noticed from eachflash at 760 nm. 850 nm is a more common IR wavelength and is moreinvisible to drivers. The filtering available at 850 nm is tighter thanat 760 nm, allowing more sun exclusion and therefore glare reduction.Both approaches are viable and with other LED providers, almost anywavelength can be used between 730 nm and 950 nm provided that it isnarrow and not broad.

The inventor has unexpectedly discovered that high angles into thevehicle may be required in order to see a phone or mobile device heldlow behind the steering wheel. As much as 80 degrees vertical fromground plane to camera may be used. At minimum, 40 degrees may berequired. Typically, trucks may require lower angles and passenger carsmay require higher angles. These high view angles may necessitate highmount positions, of at minimum 4 m and typically 7 m to 10 m above theroad surface.

The angle may comprise 30 to 90; 35 to 90; or 40 to 90 degrees verticalfrom a ground plane to camera. In one embodiment the angle may comprise65 degrees. The angle may comprise 30; 31; 32; 33; 34; 35; 36; 37; 38;39; 40; 41; 42; 43; 44; 45; 46; 47; 48; 49; 50; 51; 52; 53; 54; 55; 56;57; 58; 59; 60; 61; 62; 63; 64; 65; 66; 67; 68; 69; 70; 71; 72; 73; 74;75; 76; 77; 78; 79; 80; 81; 82; 83; 84; 85; 86; 87; 88; 89 or 90 degreesvertical from the ground.

When a lower mount is used or a mount to the side of the road is used,horizontal angle may be used to compensate for a lack of vertical angle.An angle of up to 45 degrees horizontal permits a view into the cabinwithout obstruction by the A pillar.

A camera mount position comprising a horizontal angle of between −70 and70; −45 and 45 and −30 to 30 degrees may be utilised. In roadside use,the horizontal angle may comprise up to 45 degrees. In an over-the-laneuse, the horizontal angle may comprise 0 degrees. The over-the-lane usecase may comprise a fixed installation of a high camera.

The inventor has found that the one or more camera may be placed to thepassenger side of the vehicle rather than the driver's side of thevehicle. This is because testing indicated that human behaviourpreferences using the phone or mobile device on the side with more spaceavailable. This is to the left for a right-hand drive vehicle.

By taking multiple images of each vehicle, a single camera may be usedto provide evidence at different view angles, enhancing the chance ofobtaining evidence of phone or mobile device use.

A video camera may also be provided to provide additional context, widerfield of view and sustained evidence of distraction over severalseconds. License plates may also be pulled from the video.

The infringement data comprising the one or more image may be packagedinto an SQLite database file, and may then be encrypted using a randomlygenerated AES symmetric key. The AES key may then be encrypted using anRSA public key and packaged with the infringement file. The file mayonly be unencrypted if one has the RSA private key in order to accessthe AES key. The data in the file may be hashed and encrypted using aprivate key. The hash may be checked using the public key. If the fileevidence has been tampered with, the hash will not match.

A computer such as, computer device 201, may be connected to the deviceat the site. The connection may comprise an Ethernet connection. Thecomputer may be placed up to 100 m away or mounted within 5 m. Thecomputer may utilize one or more graphics card to improve processingspeed as required based on application. A Linux operating system may beused.

Advantageously, automation may be used to reduce the image load from thecamera, i.e. to ignore images of operators not using a phone or mobiledevice. Radio Frequency (RF) monitoring approaches cannot be used asthey do not work for detecting data transmission related activities orpassive (non-transmitting) mobile device usage such as watching contentstored on the phone or mobile device. In one embodiment, image analysisis used to determine those vehicle operators using a phone or mobiledevice.

Two example automation methods are provided herein. A first classifiesan image as showing a driver using a phone or mobile device, and theother detects a phone or mobile device in an image and reports itslocation.

In the first example automation method, the location of the vehicleoperator in the one or more image is determined. This may be done bysteering wheel detection and/or person detection. The one or more imagemay then be cropped to generate an image showing only the vehicleoperator and the operator's immediate surrounds which may be defined bya wingspan. This may capture the operator and wherever the operator'shands can reasonably reach. The cropped image may then be presented to aclassifier. The classifier may then evaluate whether the image shows anoperator clearly using a phone or mobile device, an operator clearly notusing a phone or mobile device or an uncertain classification. Theclassification may provide a confidence score of each categorization.When on-phone or mobile device use confidence exceeds a threshold and/ornon-on-phone or non-on-mobile device use is lower than a threshold, theimage may be sent for further review.

In the second automation method, the entirety of the one or more imagemay be searched for a phone or mobile device using a neural network suchas, a deep convolutional neural network. If a phone or mobile device isidentified, based on its confidence score the one or more image may besent for further review. Some images may be automatically excluded ifthe phone or mobile device is associated with a passenger instead of theoperator. Some images may be automatically excluded if the phone ormobile device is detected in a holder rather than being grasped by hand.

According to any automation method, the one or more cropped image maycomprise a standardised image. The cropped image may be created using astandard width and height centred or substantially centred on the drivercoordinate. The width and height may be chosen to capture completedetail of the driver and exclude any passengers. In cases where thedriver coordinate is close to the edge of the camera field of view, thecropped image may be padded with grey so that the driver coordinateremains in the centre and the cropped image comprises a standard size.Each cropped image may then be analysed to determine the brightest anddarkest pixels. An offset may be applied to all pixels in the crop sothat the darkest pixels becomes set to zero (0), i.e. black. A scale maythen be applied to all pixels in the crop so that the brightest pixelsbecomes set to a value of 255, i.e. white. All other pixels may belinearly scaled between 0 and 255 in a histogram equalisation operation.The overall effect may be to maximise contrast in the region ofinterest. A final processing stage may be applied whereby the croppedimage is resized so that the resulting electronic file, e.g. jpeg,comprises a standard filesize.

Additionally, according to any automation method, the one or morecropped image may be adjusted to comprise a standardised brightnessand/or standardised contrast. The image adjustment may be automatic suchas by computer processing.

The automated recognition process cannot operate with 100% accuracy. Tocatch all offenders, images that do not contain phone or a mobile deviceuse will also be flagged. In a fully automated system, some or manyoffenders will be missed. Therefore, the further review may comprise amanual review step. To avoid excessive data bandwidth, this furtherreview may be done via a multi-stage process.

The automatic analysis may comprise a detection. In one embodiment, thedetection of a phone or mobile device comprises searching the one ormore image for a phone or mobile device. The search may comprise aneural network or artificial neural network such as a deep neutralnetwork or a deep convolutional neural network. The search may be of anentire image. If a phone or mobile device is detected, based on itsconfidence score the one or more image may be sent for further review.One or more image may be excluded if a detected phone or mobile deviceis associated with a passenger and not a vehicle operator or driver. Onthe other hand, one or more image may be automatically excluded if thephone or mobile device is detected in a holder and not grasped by hand.

The captured and/or received image may comprise a view of the completefront of the vehicle and the lane the vehicle is in.

The neural network may comprise an object detection system. The objectdetection system may use a neural network based YOLO (you only lookonce) real time object detection architecture such as, described athttps://pjreddie.com/darknet/yolo/.

The neural network may comprise an image classifier. The imageclassifier may comprise a neural network based VGG (Visual GeometryGroup) classifier. The classifier may receive the one or more croppedimage. The classifier may be pre-trained such as by training on a dataset such as, the 1,000 class ImageNet set. The model may be modified toidentify only two classes: received cropped images containing illegalphone or mobile device use, i.e. positive, and received cropped imagesnot containing illegal phone or mobile device use, i.e. negative. Theclassifier may have been trained by fine tuning on a training set ofexample images. The example images may comprise, more than one hundred,more than one thousand, more than a hundred thousand, or more than onemillion example images such as, cropped images. The training set maycomprise positive and negative labelled images. When the receivedcropped image of the driver is fed into the classifier network, theanalysis may determine as output a confidence that the image is positivefor phone or mobile device use. The determined confidence may comprisefor example a confidence output of 0% is very unlikely to show phone ormobile device use and a confidence output of 100% is very likely to showphone or mobile device use. A threshold may be used to limit whichimages are deemed positive and which are deemed negative. The thresholdmay comprise a threshold value which may be dynamically adjusted so thata top margin of images are deemed positive and sent on for manualreview. The top margin may comprise a top 5; 10; 15; 20; or 25% ofreceived cropped images with respected to determined confidence.

The analysis may comprise a real time object detector. The real timeobject detector may identify the driver by the presence of a steeringwheel and the human behind that wheel. The training set may compriseimages from various angles optionally, both vertical and horizontalangle variations, so that the solution can be deployed in any use caseand still detect drivers. The training set may comprise images of manydifferent vehicle types, and optionally images of both left hand drivevehicles and right hand drive vehicles. The analysis may comprise apositive identification of the driver and ignore passengers. The realtime object detector may output a location of the driver in the imageand optionally a confidence score the driver has been found.

According to any one of the above forms, when the driver has beenlocated in the received image, the received image may be cropped.

The standardised one or more cropped image may be supplied to the imageclassifier. The image classifier may receive the standardised one ormore cropped image. The image classifier may have been trained on atraining set comprising a plurality of driver cropped image examples.The training set contains labelled images of drivers illegally touchingphones or mobile device, non-illegally touching phones or mobile device,and not touching phones or mobile devices at all. When the image of thedriver is received by the image classifier, an output comprising a mostlikely category and a confidence score of making that determination maybe provided. The most likely category may be selected from: a) on-phoneor mobile device or b) not-on-phone or mobile device).

The classification may comprise determining the location of a driver inthe one or more image. The determination of the location may comprisesteering wheel detection and/or person detection. After determinationthe one or more image may be cropped to generate an image showing onlythe driver and the driver's immediate surrounds. The immediate surroundmay comprise a driver's wingspan. The cropped image may then be providedfor further review.

When one or more image has been detected with a high confidence level ofshowing phone or mobile device use, the data transfer and review systemis activated. This may comprise: cropping of the operator generated onthe camera system; uploading the cropped one or more image to a server;an operator logging in to an ‘image review’ website; the operator may bepresented with an image and may be prompted to select one of fouroptions: 1) On Phone or mobile device; 2) Not on Phone or mobile device;3) Uncertain; 4) Other; when 1); 3) or 4) are selected a message is sentto the camera system; the operator may be presented with the next imageto review; the one or more camera system may initiate a transfer of thefull encrypted infringement file, which may be sorted according to theoption selected, which may for example be transfer to the ‘On Phone ormobile device’ folder; client may download the infringement file fromthe cloud storage; and client may unencrypt and extract the infringementfile data, processing that data as it would a red light or speed offence

The server may comprise a cloud server. Currently, AWS SQS is used. Thelogging in may comprise entering login credentials.

A typical driver crop is about 100 kB, while an infringement package maybe 2 MB to 10 MB (depending on image and video options). By onlyuploading infringements when they are proven to contain data, a largeamount of bandwidth is advantageously saved.

Another advantage of the invention is that a confidence threshold toinitiate data review may be adjusted based on the needs of the client.For example, a setting anywhere on the spectrum of 0% of offencesmissed, 100% of images processed manually to 100% of offences missed, 0%of images processed manually may be selected. A typical setting may be5% missed for 10% manual processing for example.

There are different examples of use case. In a road authority use case,the enforcement camera method, device and system operates in a similarmethod to a red light camera system operates. The one or more camera ispermanently mounted and operates 24/7. It may capture evidence of allillegal phone or mobile device use, and that evidence may be submittedto a central processing centre for infringement processing. That centremay perform a registration lookup, and may sends a fine notice in themail to the registered owner.

In a Road Authority Use Case—Mobile, instead of the one or more camerabeing fixed, they may be vehicle or trailer mounted. The one or morecamera may be driven to a location and temporarily activated. The one ormore camera may be rotated through different locations on a schedule toprovide more coverage. This model is very similar to how mobile speedoperations are conducted. The processing of the data is almost identicalto the fixed use case.

Another use case is a Policing Use Case. In the policing use case, themethod, device and system is deployed in conjunction with a mannedPolice operation. The Police operation may be dedicated to thedistracted driving task, or may be conducting other operations such asdrink driving checks, registration checks or incident response.

Typically, a mobile vehicle or trailer mounted camera system may bedeployed, in the same way as the mobile road authority use case,although the method, device and system may also be deployed using aportable tripod solution. The method, device and system may capture oneor more image of each passing vehicle. If the method, device and systemdetects a high likelihood of mobile computer device use, the image maybe transmitted to the Police operation.

The one or more image may be reviewed by a human process to reduceburden on the Police, either via an internet connected remote reviewservice or by having a dedicated person deployed with the camera system.

The Police operation may view the one or more image via a convenientmethod, such as on a phone or mobile device such as a smart phone or atablet computer or other mobile device. The one or more image data willshow the offender, vehicle type and license plate. The Police may thenwait for the target vehicle to approach them, and intercept them toserve an on-the-spot offence.

The method, device and system may also be used for speed or averagespeed enforcement; use more than one camera to provide additional anglesinto to the cabin to enhance prosecutability; use more than one camerato provide depth information via stereoscopic means to enhance detectionaccuracy; provide a real-time display of offences to a variable messagesign, showing images of the offending drivers; provide survey services,showing the prevalence of the behaviour by time of day, vehicle type,location or other parameter or variable.

One embodiment of a computer system 200 and computer device 201 suitablefor use in the present invention is shown in FIGS. 2A and 2B. In theembodiment shown computer system 200 comprises a computer device 201comprising input devices such as a keyboard 202, a mouse pointer device203, a scanner 226, an external hard drive 227, and a microphone 280;and output devices including a printer 215, a display device 214 andloudspeakers 217. In some embodiments video display 214 may comprise atouchscreen.

A Modulator-Demodulator (Modem) transceiver device 216 may be used bythe computer device 201 for communicating to and from a communicationsnetwork 220 via a connection 221. The network 220 may be a wide-areanetwork (WAN), such as the Internet, a cellular telecommunicationsnetwork, or a private WAN. Through the network 220, computer device 201may be connected to other similar personal devices 290 or servercomputers 291. Where the connection 221 is a telephone line, the modem216 may be a traditional “dial-up” modem. Alternatively, where theconnection 221 is a high capacity (e.g.: cable) connection, the modem216 may be a broadband modem. A wireless modem may also be used forwireless connection to network 220.

The computer device 201 typically includes at least one processor 205,and a memory 206 for example formed from semiconductor random accessmemory (RAM) and semiconductor read only memory (ROM). The device 201also includes a number of input/output (I/O) interfaces including: anaudio-video interface 207 that couples to the video display 214,loudspeakers 217 and microphone 280; an I/O interface 213 for thekeyboard 202, mouse 203, scanner 226 and external hard drive 227; and aninterface 208 for the external modem 216 and printer 215. In someimplementations, modem 216 may be incorporated within the computerdevice 201, for example within the interface 208. The computer device201 also has a local network interface 211 which, via a connection 223,permits coupling of the computer system 200 computer device 201 to alocal computer network 222, known as a Local Area Network (LAN).

As also illustrated, the local network 222 may also couple to the widenetwork 220 via a connection 224, which would typically include aso-called “firewall” device or device of similar functionality. Theinterface 211 may be formed by an Ethernet circuit card, a Bluetoothwireless arrangement or an IEEE 802.11 wireless arrangement or othersuitable interface.

The I/O interfaces 208 and 213 may afford either or both of serial andparallel connectivity, the former typically being implemented accordingto the Universal Serial Bus (USB) standards and having corresponding USBconnectors (not illustrated).

Storage devices 209 are provided and typically include a hard disk drive(HDD) 210. Other storage devices such as, an external HD 227, a diskdrive (not shown) and a magnetic tape drive (not shown) may also beused. An optical disk drive 212 is typically provided to act as anon-volatile source of data. Portable memory devices, such as opticaldisks (e.g.: CD-ROM, DVD, Blu-Ray Disc), USB-RAM, external hard drivesand floppy disks for example, may be used as appropriate sources of datato the personal device 200. Another source of data to personal device200 is provided by the at least one server computer 291 through network220.

The components 205 to 213 of the computer device 201 typicallycommunicate via an interconnected bus 204 in a manner that results in aconventional mode of operation of personal device 200. In the embodimentshown in FIGS. 2A and 2B, processor 205 is coupled to system bus 204through connections 218. Similarly, memory 206 and optical disk drive212 are coupled to the system bus 204 by connections 219. Examples ofpersonal devices 200 on which the described arrangements can bepracticed include IBM-PC's and compatibles, Sun Sparc stations, Applecomputers; smart phones; tablet computers or like a device comprising acomputer module like computer device 201. It is to be understood thatwhen personal device 200 comprises a smart phone or a tablet computer,display device 214 may comprise a touchscreen and other input and outputdevices may not be included such as, mouse pointer device 203; keyboard202; scanner 226; and printer 215.

FIG. 2B is a detailed schematic block diagram of processor 205 and amemory 234. The memory 234 represents a logical aggregation of all thememory modules, including the storage device 209 and semiconductormemory 206, which can be accessed by the computer device 201 in FIG. 2A.

The methods of the invention may be implemented using computer device200 wherein the methods may be implemented as one or more softwareapplication programs 233 executable within computer device 201. Inparticular, the steps of the methods of the invention may be effected byinstructions 231 in the software carried out within the computer device201

The software instructions 231 may be formed as one or more code modules,each for performing one or more particular tasks. The software 233 mayalso be divided into two separate parts, in which a first part and thecorresponding code modules performs the method of the invention and asecond part and the corresponding code modules manage a graphical userinterface between the first part and the user.

The software 233 may be stored in a computer readable medium, includingin a storage device of a type described herein. The software is loadedinto the personal device 200 from the computer readable medium orthrough network 221 or 223, and then executed by personal device 200. Inone example the software 233 is stored on storage medium 225 that isread by optical disk drive 212. Software 233 is typically stored in theHDD 210 or the memory 206.

A computer readable medium having such software 233 or computer programrecorded on it is a computer program product. The use of the computerprogram product in the personal device 200 preferably effects a deviceor apparatus for implementing the methods of the invention.

In some instances, the software application programs 233 may be suppliedto the user encoded on one or more disk storage medium 225 such as aCD-ROM, DVD or Blu-Ray disc, and read via the corresponding drive 212,or alternatively may be read by the user from the networks 220 or 222.Still further, the software can also be loaded into the personal device200 from other computer readable media. Computer readable storage mediarefers to any non-transitory tangible storage medium that providesrecorded instructions and/or data to the computer device 201 or personaldevice 200 for execution and/or processing. Examples of such storagemedia include floppy disks, magnetic tape, CD-ROM, DVD, Blu-ray Disc, ahard disk drive, a ROM or integrated circuit, USB memory, amagneto-optical disk, or a computer readable card such as a PCMCIA cardand the like, whether or not such devices are internal or external ofthe computer device 201. Examples of transitory or non-tangible computerreadable transmission media that may also participate in the provisionof software application programs 233, instructions 231 and/or data tothe computer device 201 include radio or infra-red transmission channelsas well as a network connection 221, 223, 334, to another computer ornetworked device 290, 291 and the Internet or an Intranet includingemail transmissions and information recorded on Websites and the like.

The second part of the application programs 233 and the correspondingcode modules mentioned above may be executed to implement one or moregraphical user interfaces (GUIs) to be rendered or otherwise representedupon display 214. Through manipulation of, typically, keyboard 202,mouse 203 and/or screen 214 when comprising a touchscreen, a user ofpersonal device 200 and the methods of the invention may manipulate theinterface in a functionally adaptable manner to provide controllingcommands and/or input to the applications associated with the GUI(s).Other forms of functionally adaptable user interfaces may also beimplemented, such as an audio interface utilizing speech prompts outputvia loudspeakers 217 and user voice commands input via microphone 280.The manipulations including mouse clicks, screen touches, speech promptsand/or user voice commands may be transmitted via network 220 or 222.

When the computer device 201 is initially powered up, a power-onself-test (POST) program 250 may execute. The POST program 250 istypically stored in a ROM 249 of the semiconductor memory 206. Ahardware device such as the ROM 249 is sometimes referred to asfirmware. The POST program 250 examines hardware within the computerdevice 201 to ensure proper functioning, and typically checks processor205, memory 234 (209, 206), and a basic input-output systems software(BIOS) module 251, also typically stored in ROM 249, for correctoperation. Once the POST program 250 has run successfully, BIOS 251activates hard disk drive 210. Activation of hard disk drive 210 causesa bootstrap loader program 252 that is resident on hard disk drive 210to execute via processor 205. This loads an operating system 253 intoRAM memory 206 upon which operating system 253 commences operation.Operating system 253 is a system level application, executable byprocessor 205, to fulfill various high level functions, includingprocessor management, memory management, device management, storagemanagement, software application interface, and generic user interface.

Operating system 253 manages memory 234 (209, 206) in order to ensurethat each process or application running on computer device 201 hassufficient memory in which to execute without colliding with memoryallocated to another process. Furthermore, the different types of memoryavailable in the personal device 200 must be used properly so that eachprocess can run effectively. Accordingly, the aggregated memory 234 isnot intended to illustrate how particular segments of memory areallocated, but rather to provide a general view of the memory accessibleby computer device 201 and how such is used.

Processor 205 includes a number of functional modules including acontrol unit 239, an arithmetic logic unit (ALU) 240, and a local orinternal memory 248, sometimes called a cache memory. The cache memory248 typically includes a number of storage registers 244, 245, 246 in aregister section storing data 247. One or more internal busses 241functionally interconnect these functional modules. The processor 205typically also has one or more interfaces 242 for communicating withexternal devices via the system bus 204, using a connection 218. Thememory 234 is connected to the bus 204 by connection 219.

Application program 233 includes a sequence of instructions 231 that mayinclude conditional branch and loop instructions. Program 233 may alsoinclude data 232 which is used in execution of the program 233. Theinstructions 231 and the data 232 are stored in memory locations 228,229, 230 and 235, 236, 237, respectively. Depending upon the relativesize of the instructions 231 and the memory locations 228-230, aparticular instruction may be stored in a single memory location asdepicted by the instruction shown in the memory location 230.Alternately, an instruction may be segmented into a number of parts eachof which is stored in a separate memory location, as depicted by theinstruction segments shown in the memory locations 228 and 229.

In general, processor 205 is given a set of instructions 243 which areexecuted therein. The processor 205 then waits for a subsequent input,to which processor 205 reacts by executing another set of instructions.Each input may be provided from one or more of a number of sources,including data generated by one or more of the input devices 202, 203,or 214 when comprising a touchscreen, data received from an externalsource across one of the networks 220, 222, data retrieved from one ofthe storage devices 206, 209 or data retrieved from a storage medium 225inserted into the corresponding reader 212. The execution of a set ofthe instructions may in some cases result in output of data. Executionmay also involve storing data or variables to the memory 234.

The disclosed arrangements use input variables 254 that are stored inthe memory 234 in corresponding memory locations 255, 256, 257, 258. Thedescribed arrangements produce output variables 261 that are stored inthe memory 234 in corresponding memory locations 262, 263, 264, 265.Intermediate variables 268 may be stored in memory locations 259, 260,266 and 267.

The register section 244, 245, 246, the arithmetic logic unit (ALU) 240,and the control unit 239 of the processor 205 work together to performsequences of micro-operations needed to perform “fetch, decode, andexecute” cycles for every instruction in the instruction set making upthe program 233. Each fetch, decode, and execute cycle comprises: (a) afetch operation, which fetches or reads an instruction 231 from memorylocation 228, 229, 230; (b) a decode operation in which control unit 239determines which instruction has been fetched; and (c) an executeoperation in which the control unit 239 and/or the ALU 240 execute theinstruction.

Thereafter, a further fetch, decode, and execute cycle for the nextinstruction may be executed. Similarly, a store cycle may be performedby which the control unit 239 stores or writes a value to a memorylocation 232.

Each step or sub-process in the methods of the invention may beassociated with one or more segments of the program 233, and may beperformed by register section 244-246, the ALU 240, and the control unit239 in the processor 205 working together to perform the fetch, decode,and execute cycles for every instruction in the instruction set for thenoted segments of program 233.

One or more other computers 290 may be connected to the communicationsnetwork 220 as seen in FIG. 2A. Each such computer 290 may have asimilar configuration to the computer device 201 and correspondingperipherals.

One or more other server computer 291 may be connected to thecommunications network 220. These server computers 291 response torequests from the personal device or other server computers to provideinformation.

Method 100 may alternatively be implemented in dedicated hardware suchas one or more integrated circuits performing the functions or subfunctions of the described methods. Such dedicated hardware may includegraphic processors, digital signal processors, or one or moremicroprocessors and associated memories.

It will be understood that in order to practice the methods of theinvention as described above, it is not necessary that the processorsand/or the memories of the processing machine be physically located inthe same geographical place. That is, each of the processors and thememories used in the invention may be located in geographically distinctlocations and connected so as to communicate in any suitable manner.Additionally, it will be understood that each of the processor and/orthe memory may be composed of different physical pieces of equipment.Accordingly, it is not necessary that a processor be one single piece ofequipment in one location and that the memory be another single piece ofequipment in another location. That is, it is contemplated that theprocessor may be two pieces of equipment in two different physicallocations. The two distinct pieces of equipment may be connected in anysuitable manner. Additionally, the memory may include two or moreportions of memory in two or more physical locations.

To explain further, processing as described above is performed byvarious components and various memories. It will be understood, however,that the processing performed by two distinct components as describedabove may, in accordance with a further embodiment of the invention beperformed by a single component. Further, the processing performed byone distinct component as described above may be performed by twodistinct components. In a similar manner, the memory storage performedby two distinct memory portions as described above may, in accordancewith a further embodiment of the invention, be performed by a singlememory portion. Further, the memory storage performed by one distinctmemory portion as described above may be performed by two memoryportions.

Further, various technologies may be used to provide communicationbetween the various processors and/or memories, as well as to allow theprocessors and/or the memories of the invention to communicate with anyother entity, i.e., so as to obtain further instructions or to accessand use remote memory stores, for example. Such technologies used toprovide such communication might include a network, the Internet,Intranet, Extranet, LAN, an Ethernet, a telecommunications network(e.g., a cellular or wireless network) or any client server system thatprovides communication, for example. Such communications technologiesmay use any suitable protocol such as TCP/IP, UDP, or OSI, for example.

The following non-limiting examples illustrate the invention. Theseexamples should not be construed as limiting: the examples are includedfor the purposes of illustration only. The Examples will be understoodto represent an exemplification of the invention.

EXAMPLES Tripod Deployment—Day—No Flash

FIGS. 3A to 3E show images captured according to the invention using atripod deployment with images captured during the day and with no flash.FIGS. 3A and 3B allowed detection of using a mobile phone; with FIG. 3Ba zoomed in image. FIG. 3C shows that capture and reading of the licenseplate to be possible. FIG. 3D allowed detection of use of a mobile phoneand travelling at a speed ten percent greater than the limit. FIG. 3Eallowed detection of hand outside the vehicle and not on wheel.

FIGS. 3F; 3G; and 3H show other example images showing use of a mobilephone.

Vehicle Deployment—Day—Flash

FIGS. 4A and 4B; 4C and 4D; and 4E and 4F; are pairs of images capturedaccording to the invention using a vehicle deployment. The images werecaptured during the day with a flash. FIGS. 4B; 4D; and 4F are zoomed into better show the mobile phone use of the images of FIGS. 4A; 4C; and4E, respectively.

Vehicle Deployment—Night—Flash

FIGS. 5A and 5B; and 5C and 5D are pairs of images captured according tothe invention using a vehicle deployment. The images were capturedduring the night with a flash. FIGS. 5B; and 5D are zoomed in to bettershow the mobile phone use of the images of FIGS. 5A; and 5C,respectively. FIGS. 5C and 5D show that advantageously, the invention isable to detect the infringement in a far lane.

Example Deployments

The device of the invention has been successfully deployed in a mobileembodiment, in one example on a trailer, see FIG. 7A which showsdeployment in the Southern Highlands of New South Wales, Australia; andin various fixed embodiments, see FIG. 7B which shows deployment on anoverpass above the M4 Motorway in New South Wales, Australia; and FIG.7C which shows deployment on a gantry for a variable message sign (VMS)along Anzac Parade in Sydney, Australia.

These example deployments resulted in successful image capture showingdriver's using mobile phones. An example image is shown in FIG. 8A.

Six fixed site deployments in Australia were conducted to operatecontinuously for 90 days in early 2019. During these deployments8,066,292 vehicle transits were captured and analysed. From the8,066,292 transits, 95,445 drivers were positively identified to beillegally using a phone. The deployments occurred at roads with speedlimits of between 70 km/h and 100 km/h.

Six trailer based deployments in Australia were conducted in mid 2019for a cumulative total of 42 days of operation. During these deployments446,367 vehicle transits were captured, with 8,438 drivers identified tobe illegally using a mobile phone. The deployments occurred at roadswith speed limits varying from 60 km/h to 90 km/h.

In another trailer-based deployment in Tasmania, Australia, the deviceof the invention was deployed for 36 hours continuously, monitoring asingle lane of traffic. The device of the invention captured evidence of446 drivers illegally using a phone, 173 drivers exceeding the 80 km/hspeed limit by more than 7 km/h, and 51 vehicles were identified to beunregistered for more than 30 days. The device detected a total of15,984 vehicles during this time.

In this specification, the terms “comprises”, “comprising” or similarterms are intended to mean a non-exclusive inclusion, such that anapparatus that comprises a list of elements does not include thoseelements solely, but may well include other elements not listed.

Throughout the specification the aim has been to describe the inventionwithout limiting the invention to any one embodiment or specificcollection of features. Persons skilled in the relevant art may realizevariations from the specific embodiments that will nonetheless fallwithin the scope of the invention.

1.-5. (canceled)
 6. A device for detecting an infringement by a vehicleoperator, the device comprising: one or more sensor for detecting avehicle; one or more flash for illuminating the vehicle or a partthereof with light at a narrow band; one or more camera for capturingone or more image of at least a part of the vehicle operator wherein atleast one of the one or more camera comprises a narrow band filter thatlets through only or substantially only the wavelengths of lightproduced by the one or more flash; one or more computer processor forautomatically analysing the one or more captured image to detect aninfringing act; and one or more output for providing the one or morecaptured image comprising the detected infringing act to thereby detectthe infringement.
 7. A method for detecting an infringement by a vehicleoperator, the method comprising: detecting a vehicle with one or moresensor; illuminating the one or more vehicle with one or more flash withlight at a narrow band; capturing one or more image of at least a partof said vehicle operator with one or more camera wherein at least one ofthe one or more camera comprises a narrow band filter that lets throughonly or substantially only the wavelengths of light produced by the oneor more flash; automatically analysing the one or more captured image todetect an infringing act; and providing the one or more captured imagecomprising the detected infringing act to thereby detect theinfringement.
 8. A computer system for detecting an infringement by avehicle operator, the computer system comprising: one or more sensor fordetecting a vehicle; one or more flash for illuminating the vehicle or apart thereof with light at a narrow band; one or more camera forcapturing one or more image of at least a part of the vehicle operatorwherein at least one of the one or more camera comprises a narrow bandfilter that lets through only or substantially only the wavelengths oflight produced by the one or more flash; a computer processor forautomatically analysing the one or more captured image to detect aninfringing act; and an output for providing the one or more capturedimaged comprising the detected infringing act to thereby detect theinfringement.
 9. A computer program product comprising: a non-transitorycomputer usable medium and computer readable program code embodied onsaid non-transitory computer usable medium for detecting an infringementby a vehicle operator, the computer readable code which, when executedby one or more computer processors of a computer, cause the computer to:detect a vehicle based on input from one or more sensor; illuminate thedetected vehicle or part thereof with one or more flash with light at anarrow band; capture with one or more camera one or more image of atleast a part of the vehicle operator wherein at least one of the one ormore camera comprises a narrow band filter that lets through only thewavelengths of light produced by the one or more flash; automaticallyanalyse the one or more captured image to detect an infringing act; andprovide the one or more captured image comprising the detectedinfringing act to thereby detect the infringement.
 10. The device ofclaim 6 wherein the one or more camera of any one of the above forms maycomprise a 5 to 50 MP; 10 to 45 MP; or 20 to 35 MP camera.
 11. Thedevice of claim 6 wherein the one or more camera may comprise a sensorselected to maximise light sensitivity and/or minimise noise.
 12. Thedevice of claim 6 wherein the narrow band filter lets through lightbetween 700 and 1000 nm; 750 and 950 nm; 800 and 900 nm; 820 and 890 nm;830 and 880 nm; 850 and 870 nm; or 840 and 860 nm.
 13. The device ofclaim 6 wherein the one or more filter comprises an infra-red(IR)-blocking filter.
 14. The device of claim 6 wherein the one or moreflash comprises one or more light source.
 15. (canceled)
 16. The deviceof claim 6 wherein the one or more flash comprises a tightly controlledwavelength.
 17. The device, method of claim 6 wherein the one or moreflash comprises a main flash and a separate offset flash for licenseplates.
 18. (canceled)
 19. The device of claim 6 wherein a high angleinto the vehicle for the camera may be used in order to see theinfringement.
 20. The device of claim 6 wherein the automatic analysiscomprises a detection.
 21. The device of claim 6 wherein automaticanalysis comprises a classification.
 22. The device of claim 6 whereinthe automatic analysis comprises cropping the one or more image toproduce one or more standardised image.
 23. The device of claim 6wherein the automatic analysis comprises a confidence factor orthreshold.
 24. The device of claim 6 wherein a registration lookup isconducted and infringement notice is sent to a registered owner of thevehicle.
 25. The device of claim 6 wherein the detection and/or sensorcomprise a radar.
 26. The device of claim 6 wherein the one or moreimage comprises at least one image comprising a license plate; and atleast one image comprising the infringing act.
 27. The device of claim 6wherein the one or more flash comprises one or more capacitor to storecharge between flashes.
 28. The device of claim 6 wherein the one ormore flash is capable of firing 10,000 to 100,000 times per day.